Dynamical identification of open quantum systems 



3 

< 



H. Mabuchi 

Norman Bridge Laboratory of Physics 12-33, California Institute of Technology, Pasadena, CA 91125, USA 

(August 12, 1996) 

I propose a quantum trajectories approach to parametric identification of the effective Hamil- 
tonian for a Markovian open quantum system, and discuss an application motivated by recent 
experiments in cavity quantum electrodynamics. This example illustrates a strategy for quantum 
parameter estimation that efficiently utilizes the information carried by correlations between mea- 
surements distributed in time. 

The rapidly-developing theory of quantum parameter estimation (QPE) focuses on the design of optimal measurement 
strategies for extracting information about c-number parameters 9 that characterize a given quantum system. While 
much progress has been made in applying QPE to the parametric identification of prepared quantum states, little 
or no attention has yet been paid to the problem of estimating parameters that characterize a dynamical quantum 
system. In this letter I consider the latter aspect of QPE within the context of quantum optics, and describe a 
quantum trajectories method for estimating parameters that appear in the effective Hamiltonian for a Markovian 
open quantum system. 

Recent theoretical work in QPE has focused on a paradigm in which an experimenter is provided with one or 
' more copies of a quantum state p drawn from a single-parameter family p{6), and is asked to determine the value 9q 
7-H , such that po = p(@o)- The experimenter knows the form of p{&) and can make arbitrary measurements on the states 
she is given, but does not know the value of 9q a priori. In such situations one can actually derive a mathematical 
representation of the optimal quantum measurement for the purpose of estimating 9$, an d optimize over all possible 
statistical reductions of the measurement results as well Q . Accordingly, there exists a generalized version of the 
Cramer-Rao inequality § that establishes a fundamental bound on the rate of convergence for estimators based on 
repeated measurements whose marginal statistics are fully determined by a single, unchanging density matrix ||. 
My purpose here is to consider a related but distinct aspect of QPE, namely the estimation of parameters appearing 
in the equations of motion that govern the time-evolution of a quantum system. In this paradigm, which is closely 
related to that of classical system identification [Q , the hypothetical experimenter wishes to determine which system 
model TCq in a parametrized family Tt(&) best accounts for the dynamical behavior of a given quantum system. In 
' contrast to the conventional QPE scenario described above, the statistics of multiple successive measurements made 
on a dynamical system cannot necessarily be derived from any single density matrix. Roughly speaking, this is because 
+-> ' every measurement disturbs the state of the system || in a manner that depends on the measurement outcome, and 
because the evolution of the system state between measurements depends on the full details of the system's equations 
of motion. 

q-( The effects of repeated measurements on otherwise-unitary quantum evolution have been extensively studied in 
quantum optics, with regard to the dynamics of open quantum systems [p|jlO|]. The configuration most often treated 
by such work is that of a small, "encapsulated" quantum system having one or more well-defined input/output 
channels associated with its coupling to the physical environment. This picture naturally suggests a paradigm in 
which an experimenter attempts to parametrically identify the Hamiltonian of the encapsulated quantum system 
by examining the response of the output channels to driving stimuli applied to the input channels pd| ]. The task 
of quantum system identification may then be equated with that of computing the relative likelihood of an observed 
sequence of measurement results S* as a function of the parameter set 9, given the external driving conditions imposed 
by the experimenter. To the extent that the environmental couplings for the system are known, quantum trajectory 
theory jn^,[l2) suggests a simple method for the computation, which I discuss below. Having a likelihood function 
/(0|E*), one can use maximum-likelihood or Bayesian principles [^,0 to estimate the parameters 9. Note that 
it should generally be possible for the experimenter to determine optimal driving conditions that make the system 
response maximally sensitive to the values of 9, or indeed to adaptively change the driving conditions as the estimation 
starts to converge ||. 

To illustrate quantum system identification in a concrete setting, let us focus on an example with relevance to 
current experiments in cavity quantum electrodynamics (QED) — a single two-level atom placed within the mode 
volume of a driven, high- finesse optical cavity Jl4|,[l(j ■ The strength of the coherent coupling between atom and cavity 
mode is parametrized by the vacuum Rabi frequency g, whose value depends on the spatial position of the atom within 
the cavity. For a Fabry-Perot resonator g(f) = go cos(27ra;/A) exp [— (y 2 + z 2 )/wq], where x is the coordinate along 
the cavity axis and wq is the gaussian waist of the TEMoo resonator mode. The specific task I shall consider is that of 
estimating g € [0,go], which I suppose to be unknown because the atomic position is not known. The measurement 
procedure will simply be to monitor the arrival-time statistics of photons emitted by the atom-cavity system for a 
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fixed cavity driving field. For the purposes of this discussion I shall not explicitly treat the atom's external degrees of 
freedom, imagining that they are fixed by an rf Paul trap or similar confining mechanism fl5| . However, note that the 
correlation of g with the atomic position operator implies that "online" estimation of g for an untrapped atom drifting 
through a cavity could be viewed as a time-distributed quantum measurement of the position of a free mass |l6|]l7f | . 

For a gedan/cen-expcrimcnt in which the cavity is driven by a resonant cw probe laser and both the atomic fluores- 
ence and cavity emission are continuously monitored by perfect photon-counting detectors []l8f , the evolution of the 
conditional state- vector between photodection events satisfies the effective Schrodinger equation (h = 1) 

\i> c {t + dt))=e- iH °« dt \i, c {t)), (1) 
7~Lcs(g) = ig — a) a J) + it [a — a') — incra — i^/^a+a, (2) 

This interaction-picture expression for H. c ff(g) is valid under the rotating- wave and electric-dipole approximations, 
and for identical atomic/cavity/probe-laser frequencies. Here k is the field decay rate of the cavity, 7_l is the dipolc 
decay rate of the atom, and e represents the strength of the coherent driving field. The jump operator associated with 
the detection of photons spontaneously emitted by the atom is Co = \/2jj_a^, and c\ = ^/2na is the jump operator 
associated with the detection of photons leaking through the cavity mirrors. 

By registering the origins {ji, ■ ■ ■ , j n } (= for spontaneous emission or 1 for cavity decays) and arrival times 
{ti, . . . ,t n } of every photon emitted by the atom-cavity system in response to the cw driving field during an observation 
interval [io,i/], the hypothetical experimenter accumulates a classical record S* = (to, tf, {ji, U}) of the stochastic 
evolution of the system state. Assuming a uniform prior distribution on g, the likelihood function then 
simply corresponds to a normalized version of the exclusive probability density [Io|Jl2]| 



p(E*\g) = Tr 



U c s (tf,t n ; g) Cj n U cS (t n , t n _ x 5 9) ' ' ' 
x c J1 U cS (t 1 ,t () ;g) p(t ) f7j ff (ii,io;s0 c], 
x • • • J7j ff (t n ,t n _i;g) ct f/jg (t f ,t n ; g) 
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viewed as a function of g rather than S*. Accordingly, the maximum-likelihood estimate (MLE) of g is obtained by 
computing the value of g which maximizes (§) with S* fixed by the observed data. Here U e g (t',t ;g) is the evolution 
operator from time t to t' associated with the effective Hamiltonian H. e s(g) defined in equation (Q). 

In order to numerically demonstrate quantum system identification using (||), I have generated a set of classical 
records by quantum Monte Carlo simluation Q of a driven atom-cavity system with (g , 7_l, k)/2tt — (57,2.5,30) 
MHz, and three different powers for the driving field e = {24,34,44.3}. While this value for go is larger than what 



has been achieved experimentally |22|, it should certainly be within reach of works in progress. For the simulations I 
chose an arbitrary atomic position such that g(f) =45 MHz, and generated classical records with an observation time 
of 1 /is each. Figure la illustrates the stochastic time-evolution of the mean intracavity photon number, taken from 
typical Monte-Carlo data sets for each of the three values of e. The photocount statistics are clearly super-Poissonian, 
and the simulated data show that quantum jumps often occur at a local rate that greatly exceeds the rate at which 
the system regresses to steady state. 

For each Monte Carlo trajectory, an identification routine based on (|^) was used to compute the stochastic time- 
evolution of f(g I S*), as well as the corresponding MLE. Figure lb shows one typical data set with e = 34, starting 
from the inital estimate made after only one photodetection event and updated after each subsequent photodetection. 
Figure 2a indicates the ensemble-averaged convergence of the MLE for g, based on 2000 simulations for e ~ 24, 300 
simulations for e ~ 34, and 150 simulations for e = 44.3. A histogram representing the time-evolution of the MLE 
sampling distribution is given in Figure 2b, for the case of e = 44.3. With this driving field, ~ 1% accuracy in 
estimation of g is obtained in 1 fis observation time (~ 600 quantum jumps). 

It is important to note that the QPE procedure described above automatically makes efficient use of any information 
about g that is contained in higher-order correlations of the classical record of counting times. Of course, not every 
open quantum system will generate significant correlations of this type. In the scenario discussed above for example, 
the photon stream emitted by the atom-cavity system would become nearly Poissonian in the limit of either weak 
excitation (corrleated pairs of photons become rare) or of weak coupling j < k, 71 (correlations become weak). Two 
critical conditions for correlations to be strongly evident in individual classical records are that the mean time between 
counts must be comparable to or less than the system regression time [|l9| , and that the system dynamics must be 
significantly altered by the loss of a single quantum of excitation |^3j . For systems not satisfying these criteria, the 
methods described above offer no real advantage over statistical estimators based on only the steady-state density 
matrix obtained by solving the master equation associated with (^J). Accordingly, optimal parameter estimation in 
such systems can be formulated within the paradigm of conventional QPE. Judging from the trend shown in Figure 2a 
however, it certainly seems that the information rate on parameters in strongly-coupled systems can be significantly 



larger in the strong-driving regime [E4 25 1 than in the weak-field regime 
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In closing, let me note that a straightforward extension of the above method would allow the identification of 
non-stationary Hamiltonians in which the parameters 9(t) vary slowly compared to the timescale for convergence of 
the corresponding statistical estimators. Relative to the example discussed above, a recent cavity-QED experiment 
incorporating a laser-cooled atomic source [ p6[ has demonstrated the practical feasibility of achieving this separation 
of timescales. It seems reasonable to hope that the methods proposed above could be utilized in future experimental 
work to track variations in g associated with the motion of an individual atom through the mode-volume of a high- 
finesse optical cavity |l8| . A digital signal processor implementing such a procedure could be used as the state observer 
in a "semiclassical" feedback control loop designed to confine and cool the atom's center-of-mass motion. 

I wish to acknowledge invaluable conversations with H. J. Kimble, G. J. Milburn, S. M. Tan, Q. A. Turchette, D. 
W. Vernooy, and P. Zoller, as well as the support of a National Defense Science and Engineering Graduate Fellowship. 
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FIG. 1. (a) Time-evolution of the mean intracavity photon number (a 1 a) in individual trajectories. Top trace (i) is for e — 24, 
middle trace (ii) is for e = 34, and bottom trace (iii) is for e = 44.3. (b) Corresponding stochastic evolution of the (normalized) 
likelihood function f(g\S") and corresponding MLE in one quantum trajectory with driving field amplitude e = 34. The surface 
height indicates relative probability of g £ [35, 57], with a resolution of 1. The "true" value of g corresponds to 45. Note that the 
likelihood function is updated each time a photon is detected, so that the timelike coordinate in this surface plot corresponds 
to jump number rather than absolute time. 

FIG. 2. (a) Standard deviation of the maximum-likelihood estimator for g as a function of absolute time (H e = 24, 

o — e = 34, x — e = 44.3). (b) Histogram showing the evolution (in absolute time) of the sampling distribution for the MLE of 
g, representing 150 simulations with e = 44.3. 



4 




0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 

Time (microsec) 



